Workbench system

ABSTRACT

A workbench system comprising: a workbench; a multi-axis robot; a visible light projector; and a controller; wherein the workbench and the robot are located in a common workspace; the controller is configured to: determine a movement operation for the robot; and, using the determined movement operation, control the visible light projector to project a visible light indication onto at least one of a surface of the workbench and a surface of the workspace; the visible light indication indicates a limited area of the workbench and/or workspace, the limited area corresponding to a limited volume of space; and the movement operation is such that, if the robot performs the movement operation, the robot moves entirely within only the limited volume of space.

FIELD OF THE INVENTION

The present invention relates to workbenches, including but not limitedto assisted workbenches comprising collaborative robot systems for robotand human collaboration.

BACKGROUND

Work tables or workbenches are often employed by human users for workingon, repairing, assembling, or disassembling many different articles.

Assisted workbenches range from relatively simple systems, in which workbenches may be fitted with component manipulators which may be computernumerically controlled, to relatively more complex, intelligent systemsthat may include more advanced technologies.

In recent years, the use of collaborative robots that share workspaceswith humans has increased. Collaborative robots are designed to workwith or near humans to enable humans and robots to collaborate so as tocomplete tasks. Such tasks include, but are not limited to, vehicle(e.g. aircraft) manufacturing and assembly tasks. Humans may work withinor near the working space of the robot.

SUMMARY OF THE INVENTION

In a first aspect, the present invention provides a workbench systemcomprising: a workbench; a multi-axis robot comprising an end effectorfor holding an object; a visible light projector; a camera; and acontroller. The workbench and the robot are located in a commonworkspace. The controller is configured to: determine a movementoperation for the robot; and, using the determined movement operation,control the visible light projector to project a visible lightindication onto at least one of a surface of the workbench and a surfaceof the workspace. The visible light indication indicates a limited areaof the workbench and/or workspace, the limited area corresponding to alimited volume of space. The movement operation is such that, if therobot performs the movement operation, the robot moves entirely withinonly the limited volume of space. The controller is further configuredto: control the robot such that the robot presents multiple differentviews of the object held by the end effector to the camera; control thecamera to capture images of multiple different views of the object heldby the end effector; and perform a validation process using the imagescaptured by the camera. The visible light projector may be configured toproject a visible light indication onto the object held by theend-effector.

The limited volume of space may be entirely above the limited area ofthe workbench and/or workspace.

The workbench system may further comprise: one or more sensorsconfigured to detect a presence of a user within the limited volume ofspace; wherein the controller is configured to control the robot toperform the movement operation responsive to determining, usingmeasurements of the one or more sensors, that the user is not within thespace.

The controller may be further configured to control the visible lightprojector to project a visible light indicator on to the object held bythe end effector.

The controller may be further configured to determine a task to beperformed by a user using the workbench system, and control the robotbased on the determined task. The controller may be further configuredto control the visible light projector to project the visible lightindicator onto the object, the visible light indicator based on thedetermined task. The controller may be further configured to control thevisible light projector to project a further visible light indicatoronto a surface of the workbench, the further visible light indicatorbased on the determined task. The workbench system may further comprisea sensor system comprising one or more sensors, the sensor systemconfigured to identify a user in the workspace. The controller may befurther configured to determine the task based on the identity of theuser. The one or more sensors may be configured to acquire a useridentifier for identifying the user from a mobile device carried by theuser, wherein the mobile device is a mobile device selected from thegroup of mobile devices consisting of a body-worn mobile device, and aradio-frequency identification tag. The workbench system may furthercomprising a display. The controller may be further configured tocontrol the display based on the determined task.

The camera may be a visible light detecting camera

The workbench system may comprise a container, the container comprisinga plurality of compartments. The controller may be further configured tocontrol the visible light projector to project a visible light indicatoronto the container, thereby to indicate a specific one of the pluralityof compartments.

The visible light projector may comprise a laser projector.

In a further aspect, the present invention provides a method for aworkbench system, the workbench system comprising a workbench, amulti-axis robot comprising an end effector for holding an object, avisible light projector, a camera, and a controller, the workbench andthe robot being located in a common workspace. The method comprises:determining, by the controller, a movement operation for the robot, themovement operation being such that the robot presents multiple differentviews of the object held by the end effector to the camera; using thedetermined movement operation, controlling the visible light projectorto project a visible light indication onto at least one of a surface ofthe workbench and a surface of the workspace; controlling, by thecontroller, the robot to perform the movement operation; controlling, bythe controller, the camera to capture images of the multiple differentviews of the object held by the end effector; and performing, by thecontroller, a validation process using the images captured by thecamera. The visible light indication indicates a limited area of theworkbench and/or workspace, the limited area corresponding to a limitedvolume of space. The movement operation is such that, if the robotperforms the movement operation, the robot moves entirely within onlythe limited volume of space.

The method may further comprise determining, by the controller, whethera user is within the limited volume of space. The controlling of therobot to perform the movement operation may be performed responsive todetermining that the user is not within the space.

In a further aspect, the present invention provides a workbench systemcomprising a workbench, a multi-axis robot, a visible light projector,and a controller. The workbench and the robot are located in a commonworkspace. The controller is configured to determine a movementoperation for the robot, and, using the determined movement operation,control the visible light projector to project a visible lightindication onto at least one of a surface of the workbench and a surfaceof the workspace. The visible light indication indicates a limited areaof the workbench and/or workspace, the limited area corresponding to alimited volume of space. The movement operation is such that, if therobot were to perform the movement operation (e.g. under control of thecontroller), the robot would move entirely within only the limitedvolume of space.

The limited volume of space may be entirely above the limited area ofthe workbench and/or workspace.

The workbench system may further comprise one or more sensors configuredto detect a presence of a user within the limited volume of space. Thecontroller may be configured to control the robot to perform themovement operation responsive to determining, using measurements of theone or more sensors, that the user is not within the space.

The robot may comprise an end effector for holding an object. Thecontroller may be further configured to control the visible lightprojector to project a visible light indicator on to the object held bythe end effector.

The controller may be further configured to determine a task to beperformed by a user using the workbench system and control the robotbased on the determined task.

The controller may be further configured to control the visible lightprojector to project the visible light indicator onto the object, thevisible light indicator based on the determined task. The controller maybe further configured to control the visible light projector to projecta further visible light indicator onto a surface of the workbench, thefurther visible light indicator based on the determined task.

The workbench system may further comprise a sensor system comprising oneor more sensors, the sensor system configured to identify a user in theworkspace. The controller may be further configured to determine thetask based on the identity of the user. The one or more sensors may beconfigured to acquire a user identifier for identifying the user from amobile device carried by the user, wherein the mobile device is a mobiledevice selected from the group of mobile devices consisting of abody-worn mobile device, and a radio-frequency identification tag.

The workbench system may further comprise a display. The controller maybe further configured to control the display based on the determinedtask.

The workbench system may further comprise a camera. The robot maycomprise an end effector for holding an object. The controller may befurther configured to control the robot such that the robot presentsmultiple different views of the object held by the end effector to thecamera, control the camera to capture images of multiple different viewsof the object held by the end effector, and perform a validation processusing the images captured by the camera.

The workbench system may comprise a container having a plurality ofcompartments. The controller may be further configured to control thevisible light projector to project a visible light indicator onto thecontainer, thereby to indicate a specific one of the plurality ofcompartments.

The visible light projector may comprise a laser projector or alamp-based projector.

In a further aspect, the present invention provides a workbench systemcomprising a workbench, a multi-axis robot, a visible light projector,and a controller. The workbench and the robot are located in a commonworkspace. The controller may be configured to control the robot to movethe robot relative to the workbench, through a space, and control thevisible light projector to project a visible light indication of thespace onto at least one of a surface of the workbench and a surface ofthe workspace. The controller may be configured to control the robot tomove the robot along a path, and control the visible light projector toproject a visible light indication of the path onto at least one of asurface of the workbench and a surface of the workspace.

In a further aspect, the present invention provides a method for aworkbench system. The workbench system comprises a workbench, amulti-axis robot, a visible light projector, and a controller, theworkbench and the robot being located in a common workspace. The methodcomprises: determining, by the controller, a movement operation for therobot, and, using the determined movement operation, controlling thevisible light projector to project a visible light indication onto atleast one of a surface of the workbench and a surface of the workspace.The visible light indication indicates a limited area of the workbenchand/or workspace, the limited area corresponding to a limited volume ofspace. The movement operation is such that, if the robot performs themovement operation, the robot moves entirely within only the limitedvolume of space.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic illustration (not to scale) showing a perspectiveview of an assisted workbench system;

FIG. 2 is a schematic illustration (not to scale) showing a front viewof the assisted workbench system; and

FIG. 3 is a process flow chart showing certain steps of a method ofperforming a task using the workbench system.

DETAILED DESCRIPTION

FIG. 1 is a schematic illustration (not to scale) showing a perspectiveview of an assisted workbench system 100.

FIG. 2 is a schematic illustration (not to scale) showing a front viewof the assisted workbench system 100.

In this embodiment, the system 100 comprises two workbenches 102positioned substantially side-by-side, a robot 104 located between thetwo workbenches 102, and a controller 106. The workbenches 102 may beconsidered to be workbenches or tables at which mechanical or practicalwork is performed by the user.

In this embodiment, each workbench 102 comprises a benchtop 108 havingan upper surface and a lower surface, one or more leg assemblies 110attached to the lower surface of the benchtop 108, a component container112 coupled to the upper surface of the benchtop 108, a display 114coupled to the upper surface of the benchtop 108 and held above thebenchtop 108 via a frame 116, and an optical system 118 mounted to theframe 116. One or both of the workbenches 102 comprises one or moresensors 120.

The benchtops 108 provide substantially flat surfaces upon which a user122 performs work on an article, e.g. performs repair, assembly,disassembly, and/or maintenance operations, and the like.

The leg assemblies 110 are configured to elevate the benchtops 108 abovea floor or ground surface. The leg assemblies 110 are adjustable (e.g.height adjustable) such that the height of the benchtops 108 above theground surface can be varied. The controller 106 is configured tocontrol the leg assemblies 110.

The component containers 112 each comprise a respective plurality ofcompartments. In this embodiment, each compartment comprises a pluralityof a respective type of component or consumable for use by the user 122when performing a task, e.g. working on an article. Preferably, eachcompartment comprises of a given component container 112 contains adifferent type of component. Preferably, the component containers 112are arranged substantially identically, i.e. such that correspondingcompartments of the two component containers 112 contain the same typeof components. Examples of components and consumables that may beincluded in the component containers 112 include, but are not limitedto, fasteners, clips, gaskets, grommets, pipes, electrical looms,rivets, ducts, brackets, anchor nuts, clamps and adhesives.

In this embodiment, each compartment comprises a respective indicator,for example a light emitter such as a light emitting diode (LED). Asdescribed in more detail later below with reference to FIG. 3, theseindicators are configured to be activated so as to indicate to the user122 from which compartment a component should be selected for a currentoperation. The controller 106 is configured to control the indicators.

In this embodiment, the displays 114 are touchscreen displays on whichinformation may be presented to the user 122 and using which the user122 may input information. The displays 114 are operatively coupled tothe controller 106 e.g. via a wired or wireless link, such that thecontroller 106 may control the information displayed on the displays 114and such that user inputs received by the displays are sent to thecontroller 106.

The frames 116 are configured to elevate the displays 114 above theupper surfaces of the benchtops 108. In some embodiments, the frames 116are adjustable (e.g. height adjustable) such that the height of thedisplays 114 above the benchtops 108 can be varied. The controller 106may be configured to control the frames 116.

Each optical system 118 is coupled to a respective frame 116 and, assuch, its height above the benchtop 108 may be adjusted by controllingthat frame 116. Each optical system 118 comprises an optical projector124 and a camera 126. The optical projectors 124 are projectorsconfigured to project visible light, e.g. laser light projectors orlamp-based projectors, onto other components of the system 100 (e.g.onto the benchtops 108 and/or objects thereon, such as articles beingworked on by the user 122) and the surrounding area (e.g. onto thefloor, walls, and/or ceiling of the workspace in which the system 100 isoperating). Laser projectors tend to be highly accurate, and tend to becapable of providing indications to the user 122 with a high degree ofaccuracy. Lamp-based projectors tend to enable a large amount ofinformation or graphical imaging to be presented. The controller 106 isconfigured to control the optical projectors 124. The cameras 126 arevisible light detecting cameras configured to capture images of othercomponents of the system 100 (e.g. of the benchtops 108 and/or objectsthereon, such as articles being worked on by the user 122), and entitieswithin the workspace in which the system 100 is operating, such as theuser 122. The controller 106 is configured to control the cameras 126.The controller 106 is coupled e.g. via a wired or wireless link, to thecameras 126 such that images captured by the cameras 126 may be sent tothe controller 106 and interrogated to validate the image against aknown good standard.

The sensors 120 include one or more sensors configured to detect thepresence of the user 122 within the workspace, i.e. proximate to theworkbench system 100. The sensors 120 are configured to identify theuser 122. In particular, in this embodiment, the user 122 wears asmartwatch 128 on his or her wrist. The smartwatch 128 may be aconventional smartwatch. The smartwatch 128 is a mobile devicecomprising a touchscreen display. The smartwatch 128 stores data thatmay be used to identify the user 122. The sensors 120 include one ormore sensors configured to acquire information identifying the user 122from the smartwatch 128. For example, in some embodiments, thesmartwatch 128 transmits a signal to the one or more sensors 120 thatincludes an identifier for the user 122. In some embodiments, the one ormore sensors 120 interrogate the smartwatch 128 and retrieve anidentifier for the user 122.

In some embodiments, the user 122 may carry a radio-frequencyidentification (RFID) tag which electronically-stores informationrelated to the user 22 (e.g. a user identifier, which may uniquelyidentify the user), and the sensors 120 include an RFID readerconfigured to interrogate the RFID tag.

The controller 106 is configured to control the sensors 120. Thecontroller 106 is coupled e.g. via a wired or wireless link, to thesensors 120 such that information acquired by the sensors 120 (i.e.sensor measurements) may be sent to the controller 106.

In this embodiment, the robot 104 (which may also be referred to as arobot arm) is a six-axis articulated robot. The robot 104 comprises anend effector 130. The end effector 130 comprises a gripper.

The robot 104 and the human user 122 share a common workspace. Both therobot 104 and the human 122 may move within the common workspace. Therobot 104 is a collaborative robot, or “cobot”.

In this embodiment, the controller 106 comprises one or more processorsconfigured to process received information (such as camera images,sensor measurements, and user inputs), and to control the variouselements of the workbench system 100. As described in more detail laterbelow with reference to FIG. 3, the controller 106 may receiveinformation from the workbenches 102, the robot 104, the user 122,and/or the smartwatch 128. As described in more detail later below withreference to FIG. 3, the controller 106 may send information (such as acontrol signal for controlling) to the workbenches 102, the robot 104,and/or the smartwatch 128.

The controller 106 may be provided by configuring or adapting anysuitable apparatus, for example one or more computers or otherprocessing apparatus or processors, and/or providing additional modules.The apparatus may comprise a computer, a network of computers, or one ormore processors, for implementing instructions and using data, includinginstructions and data in the form of a computer program or plurality ofcomputer programs stored in or on a machine-readable storage medium suchas computer memory, a computer disk, ROM, PROM etc., or any combinationof these or other storage media.

FIG. 3 is a process flow chart showing certain steps of a method of theuser 122 performing a task assisted by the workbench system 100.

It should be noted that certain of the process steps depicted in theflowchart of FIG. 3 and described below may be omitted or such processsteps may be performed in differing order to that presented above andshown in FIG. 3. Furthermore, although all the process steps have, forconvenience and ease of understanding, been depicted as discretetemporally-sequential steps, nevertheless some of the process steps mayin fact be performed simultaneously or at least overlapping to someextent temporally.

At step s2, the user 122 approaches the workbench system 100. The user122 enters the workspace in which the workbench system 100 is locatedand in which the user 122 is to work.

At step s4, the user 122 logs in to the workspace system 100. In thisembodiment, a user identifier stored on the user's smartwatch 128 isacquired by the one or more sensors 120, and is transferred from the oneor more sensors 120 to the controller 106.

In other embodiments, the user 122 may log in to the system 100 in adifferent way. For example, in some embodiments, the user may enter auser input (e.g. a username and password) into the system 100 using oneof the touchscreen displays 114. In some embodiments, the one or moresensors 120 acquire the user identifier stored by an RFID tag worn bythe user 122, and transfer that user identifier to the controller 106.In some embodiments, the user 122 is identified by the controller 106performing a face recognition process using images of the user 122 takenby a camera 126. In some embodiments, the user 122 is identified by thecontroller 106 performing a voice recognition process using a recordingof the user's voice taken by an audio system of the system 100.

Thus, the user 122 is identified by the controller 106.

At step s6, using the user identifier, the controller 106 accesses adigital user profile of the user 122. The digital user profile of theuser 122 may be stored locally on a memory of the controller 106, or maybe stored remotely from the controller 106 and accessed via a network,e.g. the Internet, or a Local Area Network (LAN).

In this embodiment, the user profile comprises a so-called “digitaltraining passport” of the user 122. The digital training passport of theuser 122 stores skills and competencies information for the user 122.More specifically, in this embodiment, the digital training passportstores a list of the skills that have been acquired by the user 122, alist of the user's competencies, and a list of training programs thathave been completed by the user 122.

The digital training passport of the user 122 may also store, or be usedto determine or acquire, one or more permissions of the user 122. Thesepermissions may define what functions of the workbench system 100 theuser 122 is allowed to access or utilise. These permissions may be used,e.g. by the controller 106, to enable, allow, disable, or limit selectedfunctionality of the workbench system 100.

In this embodiment, the user profile comprises a log, i.e. a record, oftasks completed by the user 122 using the system 100, and dates andtimes on which those tasks were performed. This may be considered to bean “attendance record” for the user 122. This log may be limited to apredefined period of time, for example, the last year, or the last sixthmonths, etc.

In this embodiment, the user profile comprises user preferences for theuser 122. User preferences may be specified for each of a plurality ofdifferent tasks. Examples of user preferences may include, but are notlimited to, a preferred height for the benchtop 108, a preferred heightfor the display 114, a preferred handedness (e.g. left- orright-handed), a preferred lighting level for the system 100, preferreddisplay options, and preferred audio options. The user preferences maybe task dependent, i.e. there may be a respective set of userpreferences (e.g. benchtop height, display height, etc.) for each of aplurality of different tasks that the user may perform using the system100.

At step s8, the controller 106 determines a task to be performed by theuser 122. In some embodiments, a sequence of tasks to be performed bythe user 122 is determined.

In this embodiment, the controller 106 determines the task to beperformed based on knowledge of a work order, which may specify one ormore objects (i.e. products) that are to be produced. This knowledge ofthe work order may be stored locally on a memory of the controller 106,or may be received by the controller 106 from a remote location, forexample, via a network, e.g. the Internet, or a LAN. The controller 106compares the work order against the digital user profile of the user 122acquired at step s6 to select one or more objects from the work orderthat the user 122 has the appropriate skills and competencies toproduce. The controller 106 may also account for the type and number ofcomponents and consumables stored in the containers 112 thereby toensure the correct type and quantity of components and consumables forthe selected task(s) are available to the user 122. This informationregarding the components and consumables may be stored locally on amemory of the controller 106, or may be received by the controller 106from a remote location, for example, via a network, e.g. the Internet,or a LAN.

At step s10, based on the acquired user preferences and, optionally, thedetermined task, the controller 106 controls one or more of theworkbenches 102. This control may be dependent on the determined task.More specifically, in this embodiment, the user preferences specifywhich workbench 102 is preferred by the user 122 for the performance oftasks (i.e. either the workbench 102 on the right-hand side of the robot104 or the workbench 102 on the left-hand side of the robot 104). Thispreferred workbench 102 may be determined by the controller 106 from thehandedness of the user 122 specified in the user preferences. Thecontroller 106 controls the leg assemblies 110 of the preferredworkbench 102 to adjust the height of the benchtop 108 of the preferredworkbench 102. In this way, the benchtop 108 of the preferred workbench102 is moved to a preferred height above the ground as specified in theuser preferences. The controller 106 may control the frame 116 of thepreferred workbench 102 to adjust the height of the display 114 of thepreferred workbench 102. In this way, the display 114 of the preferredworkbench 102 is moved to a preferred height above the ground (or abovethe benchtop 108) as specified in the user preferences.

In some embodiments, the controller 106 may control an output of thedisplay 114 of the preferred workbench 102 based on the userpreferences. For example, the brightness, contrast, volume, layout ofinformation, format of text, size of text, etc. may be adjustedaccording to the user's preferences.

In some embodiments, other parameters of the system 100 or the workspacemay be adjusted by the controller 106 based on the user preferences.Examples include, but are not limited to, a maximum movement speed forthe robot 104, light levels within the working environment, atemperature within the working environment, and the playback of mediacontent (e.g. music).

At step s12, the controller 106 displays, on the display 114 of thepreferred workbench 102, instructions for performing the task determinedat step s8. The instructions for the determined task may be storedlocally on a memory of the controller 106, or may be acquired by thecontroller 106 from a remote location, for example, via a network, e.g.the Internet, or a LAN.

The instructions may be presented to the user 122 in any appropriateformat, for example, images, text, video, and/or audio. The instructionsmay be presented to the user 122 as a sequence of instructions which theuser is to follow in turn.

In some embodiments, the level of instruction provided to the user 122at step s12 depends on the digital training passport of that user 122.For example, if the digital training passport of that user 122 indicatesthat the user 122 is experienced at performing the determined task, theymay be displayed a simplified set of instructions, while a lessexperienced user will be provided with more comprehensive instructions.In some embodiments, if the digital training passport of that user 122indicates that the user 122 has not performed the determined task or asimilar task within a predetermined time period, the user may beprevented from performing the determined task until the user 122receives training (e.g. a refresher course). Such training may beprovided to the user 122. In some embodiments, if the digital trainingpassport of that user 122 indicates that the user 122 has not performedthe determined task or a similar task within a predetermined timeperiod, the workbench system 100 may specify that the user 122 require acertain level of oversight, inspection, or supervision when performing atask. Such supervision may be provided automatically by the workbenchsystem 100, or the workbench system 100 may contact a human supervisorto attend to the user 122 performing the task.

In this embodiment, for the purposes of explanation, the determined taskthat is to be performed by the user 122 using the system 100 is anassembly process in which a plurality of components are to be fixed to abase structure, thereby to provide an assembled object (for exampleaircraft components such as an aircraft skin or frame). It will beapparent, however, to one skilled in the art that, in other embodiments,the determined task may comprise one or more different type ofoperations instead of or in addition to such an assembly process.Examples of such operations include, but are not limited to, fastening,riveting, repairing, assembling, disassembling, machining, drillinginspecting, gluing, electrical loom manufacture and painting operations.

At step s14, the controller 106 controls the robot 104 to hold, usingthe end effector 130, the base structure.

In some embodiments, the controller 106 controls the robot 104 toretrieve the base structure from a specified location, e.g. a locationon a benchtop 108, or a compartment of a container 112. In someembodiments, the controller 106 detects, e.g. using images taken by acamera 126 or measurements taken by the sensors 120, a location of thebase structure and controls the robot 104 to retrieve the base structurefrom the determined location. In some embodiments, the user 122positions the base structure in a predetermined location, and thecontroller 106 controls the robot 104 to retrieve the base structurefrom that predetermined location. In some embodiments, the user 122places the base structure into the end effector of the robot 104.

At step s16, the controller 106 determines a path for the robot 104 thatwill cause the robot 104 to move the base structure held by the endeffector 130 from its current position to a predetermined position andorientation relative to the preferred workbench 102.

In other words, the controller 106 determines a movement operation forthe robot 104, i.e. a movement operation that is to be performed by therobot and that, if performed, would cause the robot 104 to move from itscurrent position to a predetermined position and orientation.

In some embodiments, the predetermined position and orientation isspecified in a specification of the determined task, which may beacquired by the controller 106. The predetermined position andorientation for the base structure may be acquired by the controller 106from a remote location, for example, via a network, e.g. the Internet,or a LAN. In some embodiments, the predetermined position andorientation for the base structure may be specified in the userpreferences, e.g. the user 122 may specify the predetermined positionand orientation.

At step s17, the controller 106 controls one or both of the opticalprojectors 124 to project an indication of the determined path for therobot 104 onto the system 100 and/or the nearby workspace.

The movement operation determined for the robot 104 (i.e. the movementoperation determined at step s16) would, if performed, cause the robot104 to move through or within a limited volume of space. This limitedvolume of space corresponds to or is associated with a limited area onthe system 100 and/or the nearby workspace. For example, the limitedvolume of space may be entirely above the limited area (e.g. the limitedarea may be a vertical projection downwards of the limited volume ofspace onto the surfaces system 100 and/or the nearby workspace). Theindication projected by the optical projector(s) 124 onto the system 100and/or the nearby workspace may be indicative of the limited area, e.g.the projected indication may define a boundary of the limited area, orin some other way demarcate the limited area.

In some embodiments, the controller 106 determines the limited volume ofspace based on the determined movement operation, and then determinesthe limited area based on the determined limited volume of space. Theoptical projector(s) 124 may then be controlled based on the determinedlimited area. In some embodiments, the controller 106 determines thelimited area based on the determined movement operation directly.

In this embodiment, one or both of the optical projectors 124 arecontrolled to project a visible light image (e.g. laser light) onto theupper surfaces of one or both benchtops 108 and/or the ground, therebyto indicate to the user 122 the space that the robot 104 will movethrough when the robot 104 follows the determined path. Thus, the user122 is made aware of the space that the robot 104 will move through, andthe user 122 moves outside of this space so as not to impede movement ofthe robot 104.

Advantageously, this tends to reduce the likelihood of injury to theuser 122 caused by collision with the robot 104. A likelihood of damageto the robot 104 and the base structure caused by collision with theuser 122 also tends to be reduced.

At step s18, the controller 106 controls the robot 104 to move the basestructure from its current position, along the determined path, to thepredetermined position and into the predetermined orientation.

Thus, the robot 104 is controlled to move through the space indicated tothe user 122 by the optical projectors 124.

In some embodiments, the movement of the robot 104 along the determinedpath is performed responsive to a detection that the user 122 has movedoutside of the space through which the robot 104 will be moved. Such adetermination may be made by the controller 106 using camera imagestaken by the camera 126 and/or sensor measurements taken by the sensors120 of the user 122.

At step s20, with the base structure held at the predetermined positionand orientation, the controller 106 controls one or both of the opticalprojectors 124 to project an overlay image or indicator onto the basestructure.

In this embodiment, a visible light (e.g. laser light) image orindicator is projected onto the surface of the base structure, therebyto indicate specific locations or features on the base structure to theuser 122. The projected overlay image or indicator may provideinstruction to the user 122, or may augment or reinforce instructionscurrently being displayed to the user 122 on the display 114.

By way of example, in some embodiments, an optical projector 124 mayproject an indication (e.g. an arrow) onto the surface of the basestructure which indicates (e.g. points to) a particular feature on thebase structure to which a component is to be fixed by the user 122. Thismay be accompanied by the display, on the display 144, of instructionsto fix the component to the particular feature on the base structure.Other examples, of images, indicators, embellishments, animations, andthe like which may be projected by the optical projectors 124 include,but are not limited to, circuit diagrams, wiring diagrams, safetynotices, location of components, and component drawings.

The overlay image or indicator may be stored locally on a memory of thecontroller 106, or may be acquired by the controller 106 from a remotelocation, for example, via a network, e.g. the Internet, or a LAN.

In some embodiments, the controller 106 controls one or both of theoptical projectors 124 to project the overlay image or indicator onto adifferent entity instead of or in addition to the base structure. Forexample, an indication, such as a circuit diagram, may be projected ontothe upper surface of a benchtop 108. Thus, information useful for theuser 122 may be projected to a location that is more easily viewable bythe user 122 when the user 122 is working on the base structure/object.Also for example, an indication may be projected onto the container 112so as to indicate to the user 122 a specific compartment (and thereby aspecific type of component).

In some embodiments, the controller 106 may scale and/or warp theoverlay image or indicator to match the real-world surface upon which itis projected. This advantageously tends to provide that the projectedimage or indicator correctly overlays the real-world environment, andtends to compensate for the optical projector's projection angle,distance to the real-world objects, and three-dimensional curves on theprojection surface in the real-world.

In some embodiments, the camera 126 may capture an image or images ofone or more of the overlay images or indicators projected by the opticalprojector(s) 124. In other words, the camera 126 captures one or moreimages of the entities onto to which the overlay images have beenprojected. The controller 106 may use those captured images to performan “instruction validation process” to determine whether the correctoverlay image has been projected onto the correct entity and/or whetherthe projected overlay image is being displayed correctly (e.g. that theprojection is in focus, has been scaled properly, has been warpedcorrectly, etc.). The instruction validation process may comprisecomparing the captured images of the projected overlays to images of anapproved overlay appearance, and determining whether the projectedoverlay matches the approved overlay appearance. Images may be comparedin any appropriate way. For example, in some embodiments two images arecompared by comparing the characteristics of corresponding shapes withinthose images. A distance metric may be defined and calculated for thepair of images. If the value of the distance metric is within apredefined threshold, the two images may be considered to match. If theimage of the projected overlay matches the image of the approved overlayappearance, the projected overlay may be deemed valid. However, ifimages of the projected overlay do not match those of the approvedoverlay, the assembled projected overlay may be deemed invalid. In theevent that the projected overlay is deemed invalid, the projection ofthe overlay may be modified (e.g. re-focused, warped, scaled, etc.) tocorrect the appearance of the projected overlay.

At step s22, the user 122 performs the determined task on the basestructure held by the robot 104. The user 122 may perform the task inaccordance with the instructions displayed on the display(s) 114 and theoverlay image projected onto the base structure.

In this embodiment, the task is an assembly process in which a pluralityof components is to be fixed to a base structure. The instructions forperforming the task may be presented to the user 122 as a sequence ofsteps. Each step may, for example, specify a particular type ofcomponent from the container 112 and a specific location on the basestructure to fix that component. The user may perform each of the stepsin turn, as instructed, with subsequent steps displayed only whenprevious steps are completed. In this way the user 122 may perform thedetermined task, i.e. affixing the plurality of components to the basestructure, thereby to provide the assembled object.

In this embodiment, for each step of the assembly process at which acomponent is to be attached to the base structure, the compartment ofthe container 112 in which that component is located is indicated to theuser 122 by activating, by the controller 106, the respective indicator(e.g. an LED) of that compartment. Similarly, the location in thecontainer 112 of consumables that are to be used by the user 122 may beindicated by activating appropriate indicators. Knowledge about whichcomponents or consumables are stored in which compartments of thecontainer 112 may be stored locally on a memory of the controller 106,or may be received by the controller 106 from a remote location, forexample, via a network, e.g. the Internet, or a LAN.

The controller 106 may maintain an inventory of the components andconsumables stored in the containers 112, and may update this inventorywhen components or consumables are removed or returned by the user 122.The controller 106 may request resupply of components or consumableswhen stocks are low (e.g. when the number of a given component orconsumable in a container 112 falls below a threshold). Such a requestmay be made to the user 122, or to an entity remote from the system. Insome embodiments, the controller 106 automatically orders or requests adelivery of additional components from an entity (e.g. a componentrepository) that is remote from the system 100, for example in responseto determining that a stock of a component or consumable is low. Inresponse, the requested component or consumable may subsequently bedelivered to the system 100. In some embodiments, the delivery of therequested component or consumable is performed by an autonomous vehicleor robot, hereafter referred to as a “delivery robot”. Preferably, thecontroller 106 determines or acquires a path for the delivery robotproximate to the system 100. Preferably, the controller 106 controls oneor both of the optical projectors 124 to project an indication of thedetermined path for the delivery robot 104 onto the system 100 and/orthe nearby workspace. This indication may be an indication of a limitedarea through which the delivery robot may move. Thus, the user 122 ismade aware of the space that the delivery robot will move through, andthe user 122 may moves outside of this space so as not to impedemovement of the delivery robot. Advantageously, this tends to reduce thelikelihood of injury to the user 122 caused by collision with thedelivery robot. In some embodiments, the delivery robot moves along itspath responsive to a detection that the user 122 has moved outside ofthe space through which the delivery robot will move. Such adetermination may be made by the controller 106 using camera imagestaken by the camera 126 and/or sensor measurements taken by the sensors120 of the user 122.

In some embodiments, during performance of the task, the camera 126 maycapture images of the container 112, and the controller 106 may processthese images to detect from which compartment of the container 122 theuser has removed (or added) a component. If it is detected that the user122 has removed an incorrect component for a given step of the taskbeing performed, the controller 106 may alert the user 122 to thiserror, e.g. by displaying an alert or sounding an alarm. In someembodiments, the components removed from the container 112 by the user122 are determined in a different way, for example by weighing containercontents during the performance of the task. In some embodiments, imagesof the components are displayed on the display 114 so that the user 122may verify that they have retrieved the correct component from thecontainer 112.

In some embodiments, a LIDAR (Light Detection and Ranging) scanner isused instead of or in addition to the camera 126.

In this embodiment, during performance of the task, the controller 106may control the robot 104 to move the base structure (which is held bythe end effector 130) to facilitate the user 122 performing the task.For example, the base structure may be reoriented to allow for easieraccess by the user 122 to certain areas of base structure so that theuser 122 may more easily fix components to that area. As described abovein more detail earlier above with reference to step s17, prior to and/orduring this movement of the assembled objected by the robot 104, anindication of the movement path of the robot 104 may be projected onto asurface by the optical projector(s) 124, thereby facilitating the user122 avoiding collision with the moving robot 104.

At step s24, the controller 106 controls one or both of the cameras 126to capture images of the assembled object. Step s24 may be performedresponsive to the controller 106 determining that the task beingcompleted by the user 122.

In this embodiment, images of multiple different views (i.e.orientations) of the assembled object are captured by the cameras 126.For example, in some embodiments, images of at least six different viewsof the assembled object are captured, which may include at least a topview, a bottom view, a front view, a rear view, a left-side view, and aright-side view.

In this embodiment, the controller 106 controls the robot 104 to movethe assembled object (which is held by the end effector 130) so as topresent the assembled object to the camera 126 at the multiple differentorientations in turn, and controls the camera 120 to capture the imagesof those multiple different views of the assembled object in turn. Asdescribed in more detail earlier above with reference to step s17, priorto and/or during this movement of the assembled objected by the robot104, an indication of the movement path of the robot 104 may beprojected onto a surface by the optical projector(s) 124, therebyfacilitating the user 122 avoiding collision with the moving robot 104.Thus, the user 122 is made aware of the space that the robot 104 willmove through during the validation process, and the user 122 may moveoutside of this space so as not to impede movement of the robot 104during validation. Advantageously, the tends decrease the likelihood ofthe user 122 inhibiting or detrimentally affecting the validationprocess, for example by knocking or bumping into the robot duringvalidation. Thus, more accurate validation of assembled object tends tobe provided. Furthermore, this tends to reduce the likelihood of injuryto the user 122 caused by collision with the robot. In some embodiments,during validation, the robot only moves along its path responsive to adetection that the user 122 has moved outside the indicated space. Sucha determination may be made by the controller 106 using camera imagestaken by the camera 126 and/or sensor measurements taken by the sensors120 of the user 122.

At step s26, using the captured images of the assembled object, thecontroller 106 determines whether the assembled object is acceptable(i.e. within some predefined tolerance) by performing a validationprocess.

In this embodiment, the validation comprises comparing the capturedimages of the assembled object to images of an approved assembledobject, and determining whether the assembled object produced by theuser 122 matches the approved assembled object. In this embodiment, theimage of each view of the assembled objected is compared to an image ofthe same view of the approved assembled object.

Images may be compared in any appropriate way. For example, in someembodiments two images are compared by comparing the characteristics ofcorresponding shapes within those images. A distance metric may bedefined and calculated for the pair of images. If the value of thedistance metric is within a predefined threshold, the two images may beconsidered to match. If the images of the assembled object match theimages of the approved object for each of the different views, theassembled object may be deemed valid. However, if images of theassembled object do not match those of the approved object for one ormore of the different views, the assembled object may be deemed invalid.The image comparison may be performed by comparing any appropriate imagecharacteristics, including but not limited to shape, colour, and/ortexture.

The images of the approved assembled object to which the captured imagesare compared may be stored locally on a memory of the controller 106, ormay be acquired by the controller 106 from a remote location, forexample, via a network, e.g. the Internet, or a LAN.

In some embodiments, one or more different validation processes may beperformed to validate or otherwise the assembled object instead of or inaddition to the image-based validation process. For example, in someembodiments, a workbench 102 further comprises a three-dimensional (3D)scanner which may be controlled by the controller 106. The 3D scanner iscontrolled to measure the shape of the assembled object. Thesemeasurements may be used to construct a 3D digital model of theassembled objects. The measurements may be compared to shape data of anapproved object, and the assembled object may be approved or otherwisebased on this comparison. Examples of appropriate 3D scanner include,but are not limited to, industrial computed tomography scanners andstructured-light 3D scanners.

In some embodiments, the controller 106 is configured to determinephysical properties of the assembled object using the end effector 130,e.g. based on measurements taken by one or more tactile sensors,vibration sensors, strain gauges, temperature sensors, and/or pressuresensors located on the end effector 130. Such determined physicalproperties may be used in the validation process, e.g. by comparing themeasurements against corresponding data on an approved object or to aset of electronic design data or standards.

If, at step s26, the assembled object is validated (i.e. deemedacceptable), the method proceeds to step s28. However, if at step s26the assembled object is determined to be not valid, the method proceedsto step s30, which will be described in more detail later below after adescription of step s28.

At step s28, responsive to the assembled being determined to be valid,the assembled object is released by the end effector 130 of the robot104, and the assembled object is removed from the system 100. Theassembled object may then be used for its intended purpose. After steps28, the process of FIG. 3 ends. The system 100 may then be used toassist the user 122 in assembling additional objects or performing othertasks.

At step s30, responsive to the assembled object being determined to beunacceptable (i.e. not valid), the controller 106 controls the system100 to provide assistance and/or training to the user 122. An alert maybe provided, e.g. on the display or smartwatch.

In this embodiment, assistance and/or training are provided in the formof images, text, and/or video displayed by the controller 106 on one orboth of the displays 114. Such images, text, and/or video may instructthe user 122 how to rectify faults with the assembled object, or how tocorrectly assemble the object. The information presented to the user 122on the display(s) 114 depends on the task being performed and the objectbeing assembled. In some embodiments, the format of the informationpresented to the user 122 on the display(s) 114 depends on the acquireduser preferences. In some embodiments, the information presented to theuser 122 on the display(s) 114 depends on the acquired digital trainingpassport of the user, i.e. the skills and competencies information forthe user 122.

In some embodiments, one or more reasons why the assembled object wasdeemed to be invalid are determined by the controller 106 based on theperformed validation process. For example, one or more specific faultswith the assembled object may be identified. The assistance and/ortraining information presented to the user 122 on the display(s) 114 maydepend on the one or more reasons determined.

In some embodiments, assistance and/or training is provided in adifferent form instead of in addition to the (e.g. pre-recorded)instructional images, text, and/or video displayed by the controller 106on one or both of the displays 114. For example, in some embodiments,the controller 106 may control one or both of the optical projectors 124to project an image or indication onto, for example, a benchtop 108 orthe assembled object. Such projections may, for example, indicate to theuser 122 an identified faulty part of the assembled object or a positionat which a component should be fixed but is not.

Also for example, in some embodiments, the controller 106 contacts afurther human user, and requests that other user assist the user 122.Preferably, the further user is an engineer or technician experienced inthe assembly task being performed, i.e. an expert. For example, thecontroller 106 may establish a teleconference or other communicationslink between the workbench 102 and a communications device of thefurther user. Such a teleconference may allow for the live exchange ofinformation between the user 122 and the further user. Theteleconference may include using the display(s) 114 and/or audio systemof the workbench 102 to present information to the user 122. In someembodiments, the controller 106 sends a request to the further user(e.g. to a communications device of that further user) that the furtheruser attend the system 100 to aid the user 122. The further user maythen approach the system 100 and aid the user 122. This may include thefurther user logging in to the system (e.g. in the same way that theuser 122 logged in to the system 100) and/or demonstrating a correctprocedure using the other workbench 102 to that being used by the user122 or for overriding/recovering errors in the system.

At step s32, using the provided assistance and/or training, the user 122modifies the assembled object or prepares a new assembled object toundergo the validation process. In some embodiments, the assembledobject that was deemed to be invalid may be scrapped or recycled.

After step s32, the process of FIG. 2 returns to step s24 whereat imagesof the modified/new assembled object are captured and used to validateor otherwise the modified/new assembled object. The process ofperforming the task, validation, and assistance may be an iterativeprocess.

Thus, a method of performing a task using the workbench system 100 isprovided.

An advantage provided by the above described system and method is thatimproved quality in the objects produced by the user, and fewerrejections tend to be realised. Additionally, the system tends to enablegreater flexibility of the workforce for adapting to new tasks ormanufacturing updates or revisions. The system and method of the presentinvention is particularly useful in the aerospace industry and forproducing aircraft parts such as skins and frames.

The above described system and method tends to provide for fullyautomated validation and verification of the produced objects.

The above described system may be used to provide training to users(e.g. multiple users simultaneously). This training may be automaticallyrecorded in the digital training passports of the users.

Advantageously, the above described control of the physicalcharacteristics of the system (such as workbench height, display height,display format etc.) tends to facilitate use by different users havingvarious different physical characteristics. For example, use byphysically disabled or impaired users tends to be facilitated.

The above described system may record, e.g. using the cameras, images orvideo of the user performing the task. Such recordings may be used fortraceability and/or training purposes.

Advantageously, the robot tends to provide a readily adjustable fixturefor different objects. Thus, a reliance on expensive fixturing fordifferent applications tends to be reduced. Also, the workbench systemmay be used for a wider range of applications. Also, developmentrequired for each new application tends to be reduced.

Advantageously, the robot may be fully integrated within the systemarchitecture, such that the robot is communicatively coupled to otherdevices within the system. Thus, the robot may be controlled dependenton inputs from other devices within the system.

Advantageously, the smartwatch may be implemented to measure parametersof the user's working environment, such as vibration levels, noiselevels, temperatures, gas/chemical exposure levels, dust levels. Thesmartwatch may also be implemented to measure physical properties of theuser, e.g. heartrate, blood pressure, etc. Such measurements may be usedto improve the safety of the user. For example, based on themeasurements, an alert may be displayed by the smartwatch to the user,e.g. if vibration limits are exceeded. Also, based on the measurements,certain functionality of the workbench (e.g. vibration heavy operations)may be prevented or disabled. Also, such measurements may be used toschedule tasks to be performed by the user. For example, vibration heavyactions may be rescheduled to reduce the likelihood of injury to theuser. In some embodiments, the parameters of the user's workingenvironment and/or the physical properties of the user are measured by adifferent entity, e.g. one or more sensors located on the workbench.

Smartwatches tend to be rugged and lightweight. Also, users tend to beaccustomed to wearing such devices. Conventional smartwatches tend to beeasily adapted to provide the functionality described herein.

In the above embodiments, the assisted workbench system comprises twoworkbenches. However, in other embodiments, the assisted workbenchsystem comprises a different number of workbenches, for example only asingle workbench.

In the above embodiments, the assisted workbench system comprises asingle robot. However, in other embodiments, the assisted workbenchsystem comprises a different number of robots, for example more than onerobot.

In the above embodiments, a workbench comprises a display. However, inother embodiments, the display may be omitted. For example, in suchembodiments, information (e.g. instructions, alerts, etc.) may bedisplayed on the user's smartwatch.

In the above embodiments, the robot is a six-axis robot arm. However, inother embodiments the robot is a different type of robot. For example,the robot may have a different number of rotary axes about which it maybe controlled to move. Also, in some embodiments, the robot may includeone or more linear axes along which the robot may be moved. For example,the robot may be mounted to a rail or track along which it may be slid.Alternatively, the robot may be mounted on a vehicle (e.g. anautonomous, semi-autonomous, or human-operated vehicle) which can becontrolled to move to a desired position around the workbench.

In the above embodiments, the end effector comprises a gripper. However,in other embodiments, the robot may comprise a different type of endeffector instead of or in addition to the gripper. Examples ofappropriate end effectors include, but are not limited to, additivemanufacturing (AM) apparatus, drills, cutting tools, riveting apparatus,sealant deposition apparatus, part marking apparatus, and laser etchingapparatus.

In the above embodiments, the camera is a visible light camera. However,in other embodiments, one or more other types of imaging device may beimplemented instead of or in addition to the visible light camera, forexample an infrared camera, an ultraviolet camera, or a full-spectrumcamera.

In the above embodiments, inspection and validation of an object isperformed at the end of the assembly process. However, in otherembodiments, inspection and validation of an object is performed at oneor more intermediate stages during object production. In someembodiments, inspection and validation of an object is performed at oneor more discrete points during production, while in other embodimentsinspection and validation of an object is performed continuouslythroughout its production.

In the above embodiments, the initiation of training and/or assistanceprovision is automatic, e.g. in response to a determination that theassembled object is invalid. However, in other embodiments, trainingand/or assistance may be requested by the user manually, e.g. by tappinga “help” icon on the display or on the smartwatch.

In the above embodiments, the user wears a smartwatch. However, in otherembodiments, the smartwatch may be omitted. For example, a differenttype of mobile device that may be carried by the user may be used.Preferably, the mobile device is a body worn mobile device, such assmart-glasses.

In the above embodiments, the controller may acquire various informationand data from a remote location, for example, via a network, e.g. theInternet, or a LAN. For example, in some embodiments, the assistedworkbench system (and optionally multiple other workbench systems) areconnected to a common Enterprise System (ES), for example via a brokermodule. The ES may include software packages that support businessprocesses, information flows, reporting, and/or data analyticsthroughout the network of workbench systems. The ES may compriseresource and scheduling information and information relating to workorders, information relating to possible tasks, and instructionsrelating to those tasks. The ES may comprise video, images, audio files,CAD drawings, and the like. In such embodiments, preferably intermediatesoftware (e.g. middleware) is coupled between the operating system ofthe workbench controller and the ES. This intermediate software may becomprised with a workbench system (e.g. within the controller). Thisintermediate software may act as a bridge between an operating system ofthe workbench and the ES. This intermediate software may allow theworkbench to operate with the ES without the workbench and the ES beingphysically integrated. This tends to provide that the workbenches are“plug and play” apparatuses that may be connected to, and work with,different Enterprise Systems.

1. A workbench system comprising: a workbench; a multi-axis robotcomprising an end effector for holding an object; a visible lightprojector; a camera; and a controller, wherein the workbench and therobot are located in a common workspace, and the controller isconfigured to: determine a movement operation for the robot; and usingthe determined movement operation, control the visible light projectorto project a visible light indication onto at least one of a surface ofthe workbench and a surface of the workspace, wherein the visible lightindication indicates a limited area of the workbench and/or workspace,the limited area corresponding to a limited volume of space, themovement operation is such that, if the robot performs the movementoperation, the robot moves entirely within only the limited volume ofspace, and the controller is further configured to: control the robotsuch that the robot presents multiple different views of the object heldby the end effector to the camera; control the camera to capture imagesof multiple different views of the object held by the end effector; andperform a validation process using the images captured by the camera. 2.The workbench system of claim 1, wherein the limited volume of space isentirely above the limited area of the workbench and/or workspace. 3.The workbench system of claim 1, further comprising: one or more sensorsconfigured to detect a presence of a user within the limited volume ofspace, wherein the controller is configured to control the robot toperform the movement operation responsive to determining, usingmeasurements of the one or more sensors, that the user is not within thespace.
 4. The workbench system of claim 1, wherein: the controller isfurther configured to control the visible light projector to project avisible light indicator on to the object held by the end effector. 5.The workbench system of claim 1, wherein the controller is furtherconfigured to: determine a task to be performed by a user using theworkbench system; and control the robot based on the determined task. 6.The workbench system of claim 4 wherein the controller is furtherconfigured to: determine a task to be performed by a user using theworkbench system; control the robot based on the determined task; andcontrol the visible light projector to project the visible lightindicator onto the object, the visible light indicator based on thedetermined task.
 7. The workbench system of claim 6, wherein thecontroller is further configured to control the visible light projectorto project a further visible light indicator onto a surface of theworkbench, the further visible light indicator based on the determinedtask.
 8. The workbench system of claim 7, further comprising: a sensorsystem comprising one or more sensors, the sensor system configured toidentify a user in the workspace, wherein the controller is furtherconfigured to determine the task based on the identity of the user. 9.The workbench system of claim 8, wherein the one or more sensors areconfigured to acquire a user identifier for identifying the user from amobile device carried by the user, wherein the mobile device is a mobiledevice selected from the group of mobile devices consisting of abody-worn mobile device and a radio-frequency identification tag. 10.The workbench system of claim 9, further comprising: a display, whereinthe controller is further configured to control the display based on thedetermined task.
 11. The workbench system of claim 1, wherein the camerais a visible light detecting camera.
 12. The workbench system of claim1, wherein: the workbench system comprises a container, the containercomprising a plurality of compartments, and the controller is furtherconfigured to control the visible light projector to project a visiblelight indicator onto the container, thereby to indicate a specific oneof the plurality of compartments.
 13. The workbench system of claim 1,wherein the visible light projector comprises a laser projector.
 14. Amethod for a workbench system, the workbench system comprising aworkbench, a multi-axis robot comprising an end effector for holding anobject, a visible light projector, a camera, and a controller, theworkbench and the robot being located in a common workspace, the methodcomprising: determining, by the controller, a movement operation for therobot, the movement operation being such that the robot presentsmultiple different views of the object held by the end effector to thecamera; using the determined movement operation, controlling the visiblelight projector to project a visible light indication onto at least oneof a surface of the workbench and a surface of the workspace;controlling, by the controller, the robot to perform the movementoperation; controlling, by the controller, the camera to capture imagesof the multiple different views of the object held by the end effector;and performing, by the controller, a validation process using the imagescaptured by the camera, wherein the visible light indication indicates alimited area of the workbench and/or workspace, the limited areacorresponding to a limited volume of space, and the movement operationis such that, if the robot performs the movement operation, the robotmoves entirely within only the limited volume of space.
 15. The methodof claim 14, further comprising: determining, by the controller, whethera user is within the limited volume of space, wherein the controlling ofthe robot to perform the movement operation is performed responsive todetermining that the user is not within the space.